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FOREWORD 



The Hun- Factors Technical Area is concerned with the ^e:ri^ds 
of the- futur. > - uttlef ields for increa.3ed man-aachine coraplexi ac- 
qiiz^re, transc. . process, dis'seiuinatt-. and ut:Llize informatior. The 
r^isearc- is t\-u.^c pn the interface problems and in t^er actions «^thin 
crnnnnanc and ^tr-ol centers and Is concemec v.-ith 'such areas as ropo- 
graDhic -rodv^ and procedures, tacrlcaj s^Tniiology, user-oriented, sys- 
ten^s, Lnr::rm: management, staff oper^tli^-r^ and procedures, and sen- 

3p: sysrems . j-dgration ani utilization. ^ ' \ 7 

-.-e - -|A.c-i aspect of intelligence if/ formation "from -aerial sen- 
so: is thr o'. ^are location of targets. Refienti: , the Army ^has "devel- 
3pe J rhe iinalv leal Phbtograinmetr: c Positior. .ng System (APPS) wljich 
^^pro -^der. ar. ove'd capability for targ- ^ p ^sltioning.. However', there- 

are ..evera. . ..,:i:own factors in this r-'St^tr: associated with the human 
interraLe. ^resent publication ^.als witih the deterrainatiion of the 

spee ami cur _iL:y with which opera: .rs car ir.^srer terrain positions 
froiE ely -arge-scale mission , ntogz ^hs tc small-scale data- 

base ertiic ^ .otographs and^ the dep -adep.^-r of su::h performance" on ^the 
of the photographs used-. This is a critical factor of 
^"^^^^^ ^ ^^fo^ed by the ope- ^tror the A?PS. Results indi- ■ 
catcT tr>: no*-: important yai iabl- /err how close the target is 

to^ar identl - terrain detail; w: .ler : "e -arger is >in the fore- 

ground or bixcki:- jid of^ a non-vertd mag? and the resolution t»of the 
mission imager'* 

Research la the area of sensor ^arems Integration and utiliza- 
ti(^n .is concuctred as an in-house eff rm augaEnted through contracts 
with crganizat— ons selected for their -TiiquiP capabijilties and facili- 
ties for resear::h on 'sensor systems. The pr-«sent study was conducted - 
by i>«x;saniiel f rom.^Rayt'he6h''eoihpany/Autometriv^^nd Humao/ Factors Research 
t-c under contract DAUC19-73-C-0031 with^ p- .;;ram direction from Abraham 
H. £:Lrnbaum. This effort is responsive to "^^luirements of Army Project 
20162106A72 2, the U.S. 'Army Engineer Topogr^^pnic Laboratory, Ft. Belvoir 
Va. . and the Assistant 'Chief- of Staff for Ir' -^f^lligence. Special require 
mer-s -are contained i^ Human Resource Needs 73-65. 




/JOSEPH 7*^=imm. 

ihnica^ D. rector 
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. THE 2PPECTS OF PHOTO .CHARACTERISl^ICS UPOIN LOrCATICSffi pETESMZasvTION IN A 
PHOTOGRAMMETRIC FACILITY - : \ 



BRIEF 



RequSremenx: 

^ , JO dersrmine how well an image interprerar can transfer image 
POinn^ f rar raconnaissance (stimuliis) pirctography .to a "small-scale 
photagis^apaxc data base, using photographiy from vertical fr:ame, oblf^e , 
frame, and pajioramic cameras as stimulus imagery. / 

Procedu=:s. : • • . . • '/.'■'. 

' : . "... ■ ■ ^ i ^ . . / . , 

^••uxi ts selected for trasnsferrizi^; were: Type A points appearing 
on ide:ir::^^able ground obje™s and Type B points more than 20Q meters 
from _^tr^:r_liajDle ground ob-si^ rhesB were marked on negatJ,ve's of 
'high- iLxzi l3w-altitude vert:L:.:al ph9togr.3i2ns , high- and low-altitude . 
panoranniL: pnotographs/ and 'arr oblique phorograph, using varying scales. 
Transp^-rasr.t prints c^nd paper x>xints were made from each negative. A ' 
photogr-^n^c data base" at a ,,^=ai^ of mao,000 was obtaiined - f pr -each 
area cc .-v: . ed by^' the stiBiulus Jaiagery, / , ^ 

Afrer a short pretest tr*.i-ning period, 40 Army imsge interpreters 
were recrrz^rer ro transfer 30 T^-oints from each of the fcrur 'different . /' 
types at stinnulus phot6graphy -o the appropriate data base by markiHg^ 
the sele-rted points.. Time re::zired to transfer each^^^ci/nt was- recor 
Coordinates nr the marked pornrs were, compared to the true' coordinates / 
and error Vectrors listed. Tfe effects of resolution, scal'e^, and pbsi-- 
.tion on location accurac^r were statistically tested /and described. 

.Findings ; ' ■• _ .. ; ■ • v ■■ ''■'/' . //■ 

ffrtt^tr-nsfej: accuracy was affected most by the relationship of 
-to idtentifiable deta. 1 imaged on both the stimulus and data 
>ase ph^ograpnyT ' Type/A^ pdi.^^ located more accurately than < 

€^e B^poin|:s ratios of 3:1 to'^G:!*. . 




Accuracy was also affected by the position of a point in- the Near 
or Far portion of a non-^rtical photogrraph.- (Near ia- defined as the 
half of the photograph closest to tt}fe vertical. -Far is -he horizon- 
half of ''the photograph. )| Points in the . Near portion were 'locared more 
accurately than- points in the Far portion. . Examples of error magnitudes 
at the 75th percentile ^re: ' . 



Oblique, B-Point:s Near- -54 meters. Far- 229 meters 

Hi^h Pan, A-Poirit|b Near- 14.. meters Far- 32 meters 

The difference in //ground, resolution -{paper print vs. transparency) 
was most signifiqant fdr^Type A points on the Low Pan imagery. The 
transfer error foWthe|| transparent print was 25 meters compared tO' 165 
meters for the paper p|rints. For other irfiss ion imagery tlie resolution 
difference was of no practical consequence'. / 

r • I ■ ■'■ 

Under the conditions o5 these tests, transfer ..errors of less' than 
20 meters can be met 50% of the nime for Type A points on aid imagery 
and 75% of the time ftTf Vertical and Near High and' N^a^ Low Pam photos. . 
Only the Vertical imagery, is adequate for keeping Type 3 point transfer 
'r'. errors to 20 meters, f ' , ^ - ' 

; Test subjects prjef erred transparencies to paper, prints^^^foP'the- stiAu 

\lus imagery and they |pref erred transmitted light flight table^) to- re--%^ '* 
. .fleeted light (high-ijntensity lamp) 'even tor paper prints. ^ 

.utilization of Findings: ^ " ' ' * 

• This study show^ clearly that large erroYs may result in 'the po^nt 
transfer process. Targets appearing on identifiable fisatures visible on 

^both the mission and ^ata base imagery (.Type A points) can generally .be 
transferred to wifehiri 30 meters at 75th percentile. However, even, for 
Type A points, when, t^e resolution of the. mission imagery falls too* Ipw 
because of scale arid position, the accuracy deteriorates rapidly * For 
this case an acceptable level of resolution can be maintained , by using ^. 

, transpeurent prints instead of paper prints.. Transfer accuracy improves 
overall when transparent prints are used. This strcgigly suggests the ' * 
use of equipment on which transpArencies can be viewed and the opera- 
tional iise of tran^arencies instead of pape!r prints. 

Type.B points cannot be transferred visually to acceptable accu- 
racies with any^ consistency. Since most target points are likely rto be/' 
Type B points, a way must b^V^ound for improving the transferring^of 
these points. . • 



The-Idifference i3i tr^isst^i' cr-ror iseWeen scales for liextical 
siQax^imaLgery. not r 7^ -^ t^o n- .^y ^ign^f-£,cant , -This does me 
that scaie is ncrt an inanarYan- aczror. Rather, it indicates that 
ground re soluticm of al^ v/^n 3::^ssipn imagery used in-tjfie tes 
was higher than rhe corrn^^^pon^dinc ±sta base groimd resolution, r 
follows that hdcrhei^'qua -y data nsxse phonography might permit be; 
utilization of vertical nur^sion mEaery jinfthe transferring procei. 
Higher groiind zssiolutio. . za^- be Jirrziined by better cairferas (iens-r 
combiniations) or by Larcep^ ;c-*le datta ba^s, " \ ^ 
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THE EFFECTS OF PHOTO GHARACTERISTICs' UPON LOCATION 
DETERMINATION tN A PHQTOGRAMliETRIC FACILITY 



■ ■ J:'- ■ 

INTRODUCTION ^ ^ 



Ma^y*photograinme trie 'applications require the'locating aj^maxking 
of the Images of the same ground point on one or more sensor records^ 
In aerial triangulation, pass points and control points are transferred 
stereoscopically from one photograph to one pr more iJverlapping photo- 
graphs. In terrestrial photogramme try, identyal image points on two 
photographs must be measured, garget images found on reconnaissance 
.imagery are often transferred to .a map or some other type of data base 
so their ground positions can be found. The accuracy with which a point 
can be transferred from one sensor record to another is a function of 
many factors, such as resolution, scale, relative^ attitudes, target/en- 
v^ons relations and technique and equipiaent used. Also, the intended 
application dictates, to .some. extent, the care that is given to such 
transfers. * » 

Therp is a continuing need fot more accurate and faster means of 
..'acquiring aiming data for the artillery.^ This is es^yecially true in 
areas where adequate maps ar^' not available. Tlie United States Army 
Engineer Topographic Laboratory,' Ft. Belvoir, Va. has developed 'an v 
i-ristniment which, together with a -precision photographic data base, pro- 
vides a new capability for target positioning. This instrument is 
called- the Analytical Phdtogrammetric Positioning System (APPS)-^ It 
consists essentially of a. mirror stereoscope mounted over a coordinate 
measuring syst^ whose outputs are fed to an interface unit and then to * 
a programmable ^^sk calculator . Two overlapping data base photographs 
are mounted on the^ two stages of the mirror stereoscope. After pre- 
limipary indexing and checking, index. marks are placed over a point of 
interest and the attached calculator computes the X, Y, and Z ground 
coordinates of tfie point of interest.- The inherent accuracy of the- * 
APPS has bejen found to be adequate for locating the artillery fie'^ld 
Viece and the target and for some other types of ground surveying* 
The unknown factor in this positioning System is the error associated 
with the transferring of points to ;a data base from seyeral types of 
photpgraphic imagery of different scaled and resoltlfions, and the r'e- 
lationships of the targ.et to features in the scene (target/environs). 




-^A more detailed descriptio4;i of the APPS is given in Appendix'A. 



-transferring .of imagle pdints j^rom on^cjrKptograph*' to another seems 
straightforward and quite exact. This, may te^rue under some circum-^ - 
"stances but not -under others. It has been shown in preciision photogram- 
metric applications tha't when a reasonably %ood, stereo model can be 
formed, with two phbtographs, conjugate images^^an be mar leech on the 
pho'tographsw'ith very high' accuracy-^-ten (10) micrometer^ ^or less. But ' 
when the two photogrMh^ differ in scale, resolution, attitude, etc., 
the ^problem becomes cme of - trying to match two dissimilar types of 
photographs. Some of the differences thafe^ust.be considered are iis— 
cuss^'ed below. , - ^ 

J/ ( -: . . ' - 

Scale of the D^ta B^a^e' ^ . - 

^ The scale of' the photo d^ta bases no^bein^ used with the APPS is^ 
1:100,000'. Dkta base scales as small as ltl60,000 are being considered 
for adoption^! At a scale of \:100,000, ten micrometers on the data bas'e 
•represents onelmetea: on the ground. A maxipXim of 20, meters per coordi- 
nate dimension »has been pifo^ected in the APPS error* budget for the 
transfer accuracy of points located in friendly terrain, while 50. meters 
per dimension for transfer accuracy of points ^located in enemy i:errain 
has been allpcated.' This means that a target point must be transferred 
to th^ data base with an accuracy of 1/5 millimeter (200 micrometers). 
This leaves very little margin for errdr., 4^d "In areas with few or -no 
prominent scene features it may be extremely difficult to tranjsjl 
^point "by association" to this accuracy. ^ * 

Scale and Geometry of Re'connaissance Photography 

y Targets can be imaged by any one of 'a variety of reconnaiss ^ 
cameras. ^Panoramic and oblique cameras product photographic imager^Jr 
that has geometry different from that, produced by vertical fr^me 
cameras. The farther the target is from- the vertical, ^the greater the 
difference in geometry; As. the 'Kbt^zon is approached it becomes 'dif- 
ficult even ♦to locate the general area^^-irT which th'e target is located,^^ 
one , reason' being that the scale becomes smaller as one moves from the 
nadir towaifds the hori^oft, and ground features become masked .by higher^ 
elevations on the camera side 'of the scene. These contortions', plus" 
the fact /that, usually, there' is a large scale diff^aTence between the 
mission imagery and the photo data base^, are' -important . f«ctt)rs^hen 
trying tp correlate two dissimilar types of imagery to the required 
accuracy. Of course the scale of the data base can be enlarged opti- 
cally so it will be closer to ttfe mission imagery scale. The optics 
of the APPS are fixed at 6X's6 that was the maximum enlargement permit- 
ted for this stydy, Evfen if zoomj'op t;Lcs are permitted, very little 
additional useful information can^be expected unless "the data base ' 
photography is of tamisually fine quality^. * ^ , 
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Other ^Factbrs/ ' 7- " ' 

■ • y - * • ■ ■ ■ ■ i . . ^- 

Some of the otjier factors .that can . cause problems in transferring . • 
points are; ' • ' - ' . , - * * V • < 



• seasonal differences^ in the. t^ime of' exposure of the 
data b^^^esphotography and the ''mission imagery. 

• Different 'Requisition times of the data base and. the. 
mission photo-g^aphy. New r6ads> railroads^ and ' , - ^ 
housing developments, different .water levels of rivers 
and lakes, diff erent crop " patterns, .etcTmay be^on 
one" photogr§pli and ^not'^the o ther . ' This may dause con— 
fusioijL in^transferrring ;points. . " > 



OBJECTIVE: 



si 

4 



The .^jjbjjective of ..this study was to : determine how well anMmage ' 
interpreter coul4 transfer image points, from a reconnaissance plio to- . 
^ra:ph to a small scale photographic dataT^ase^ Tests were designed to 
determine both' the accuracy and the speed of transfer. Mission (recon- 

li.ssance) iJhotographs' used in the teists were selected frames from 
obrtqir^, panoramic and vertical frame cameras at various scales and 
resolut^DTMU^ — -ilie. data bases weire vertical maplping photogr<5iphs at 
1:100,000 scale.. , 

SCOPE 



• ThJLs study was iimit-^d to the one act pf transferring points from 
, one type of photography (mission imagery) t-^o another type of phatog-, 
. raphy /(data base) . The' transferring was done visually, i.e. , no instru-* 
mental aids, other tharj- small tube-type or linen tester magnifiers, were 
allowed-. APPS operations were apiproximated. by using, in this study, the 
same. type of photographic material used in APPS,. by limiting the magni- 
fication of the data base" to 6X-, and by using, the same scale data base. 
The tests were designed to provide information on the accuracy and speed 
of transferring points from mission 'imagery for combinations of the 
following v^.riables: 



• Types of imagery ^vertrical, panorai^c,. oblique^^ 
- / Scale • / • ' . . 

• Resolution (positive transparency vs. papet print) 

• Point/environs relationship. 

. . / ]\ . METHOD 

Experimental/Design . ' \ ^ 

Th^Sexperimental design for the vertical mission photos was a 
"2x2 factor\al.' The effects of Print Type, Scale, and the interaction, 
between th/ two variables were between groups. The experimental 
d,esign f o/ each of the non-vertical photos was also a 2:^2 factorial. 
The effect" of Print Type was between groups, but the effects of ^ 

■■ ■ . '^^ ■ V?. . ••" 'Srf-'. ... ' ' ' 

. ■■■ . ^^ ' ■■ . ■ ■ "• •'■ -3- ■ . " ' ■ • ■ ^ 



Position and the interaction between .th^tjpwo variables were within 
groups'. ' As be seen in Table 1, each group, of subjects transferred 

the. points from four mission photos — one vertical photo and three non- 
vertical ghotos./ . * 

* • • Table 2 shows the order in which "the four mission photos were 
presented. to eich^of the groups. -Within each group^ half 'of the sub- 
jects were giv^en one sequence of the four- ph^os and the other half 
another sequence.' _The filiotb sequences were varied across groups 
to control for the effects of time-correlated variables^ .such as bore-, 
dom, fatigue, and learning. An equal number of subjects were presented 
with each non-vertical -photo, first, second, third, and fourth.^i>'i^^^^ 
example, five^ subjects workeH with Bj . the oblique transparency first, 
a different fi^^e subjects with it second, etc. An -^qual number of 
subjects were presented with each ^^rtical photo either first and 
second, or third and fourth. ^ * ^ 

Foi^each photo, half of the subjects transferred the points in 
one sequence and the remaining half in the reverse sequence. I^^ the 
case of the non-vertical photos, half of the Objects transferred the 
points sta^rting at the horizon and working to\^rd the nadir, and the 
other half transferred. the points in reveiise sequence. This was done 
to mihiiRiize any bias in performance .on the' Near and Far points and on 
the A arid B points due to the ^potential effects of any tdme-i;orrelated 
vairiables . . - ^ 



Subjects ^ >• 

Forty enlisted image interpreters from the 1^^ Military Intelli- 
gence Battalion, Aerial Reconnaissance Support (Is t mIBARS) , Ft . Bragg, 
North Carolijia served as subjects.^ The experience of the image inter- 
preters rangei from one year. to oyer twenty years. The forty subjects 
were assigned randomly in equal - niimbers to qnf of four groups. A given 
combination of Print Type and Scale for the vertical photographs was 
assigned to each grpup. Thus no subject viewed the same sc^ne more 
than once. Transparencies of each of the non-vertical photos were 
assigned to two groups and Paper Prints to the two remaining groups. 
Here, again, no subject viewed the ^ same scene -more tharf once. The 
experimental condition by groups is \ShQwn in Table 1. 

Variables 

I ndepende'n t Variables . 3;here were two independent variables for 
the vertical mission photos and two for the oblique, the high pan, and 
the low pan mission photos. The independent vari':ables for the vertical 
photos wer.e scale and ground resolution. Scale change was achieved by 
selecting different flight altitudes* and resolution difference was 
achieved by. the use of paper- prints and transparencies of the mission 
piiotos. Hereafter these two^ variables will .be referred to as Scale 
and , Print Type. The indepen^dent variables for each of the non-vertical 
photos .were Print Type and Position of- the point (Far vs. Near),. Near 
pointis are defined^ as those located in the^half of the photo which is 



Table 1 

EXPERIMENTAL CONDITIONS BY'GROUPS 



MISSION PHOTO 




•p'rint 


TYPE 




SCALE 


Paper 


Trans- 
parency. 


Vertical 


Large 


Gp 1-^ 


Gp 2 


Small 


Gp 4 


' Gp 3 ' 



Oblique 



POSITION 


PRINT TYPE 


Paper 


Trans- 
parency 


Far 


Gp 3 
Gp 4 


Gp'l 
+ 

Gp 2 


N,ear 



High Pan 



POSITION 


PRINT TYPE 


Paper 


Trans- ' 
parency 


Far 


Gp 3 
+ 

Gp 4 


Gp 1 
+ 

.Gp 2" 


Near ' 



Low Pari 







PRINT 


TYPE - 




POSITION 


Paper 


Trans- 
parency 




Far 


Gp 1 


■ -Gp 3 

/ + 


* •. _ . 


Near 


•Gp ^2 


Gp 4 



subjects in a group (Gp), .Each cell represents a photo 



Table 2 

0-RDER OF MISSION PHOTOS BY GROUPS 



GROUP^ 


N 


OR-DER 


1 c ^ 


i 9 n H 


o ra 


- 1 n 


Gp 1 » 


5 




Bi 


D2 




5 




c, ' 


A^ : 


B, 


Gp 2 


5 , 




Da 


C 1 


A, 


1 

5 


c, 


As 


"— 1 — n — " 

B, : 


D2 ■ 


Gp 3 


5 


A2 






Ca 


5 


D, 




'A,, 


B2 


Gp 4 


5 


bV 


Di 


€2 


Ai 




5 




Ai 


B2 


.D i .•• 



NOTE: A = Vertical Photos 

1 = Small Scale/Transparency 

..■ - 2 = Small Scale/Paper Print 

3 = Large Scale/Transparency, 

«♦ = Large Scale/PapeiL Print 

' B = Obi i que^ Photos 

C = Hi gh Pan Ptiotos 

D = Low Pan Photos 

Fbr B, C, and D 

1 = Transparency 

2 = Paper> Print 



♦ . * ■ ' 

closest to the/vertical. Far points; are^ defines as those located in 
the hoxizon-half of the photograph, . . 

Dependent Variables , The dependent variables for these tests 
were the location error '(in micrometers), and the time (in seconds) 
required to* transfer a point. ". . ' 

Control Variables - The control T^riables were the tyo types of 
points, A and B. The points were selected in--fearms jof ' significant 
background det'ail, i.e., point/environs. 



Development of ExperiAerltal. Materials . ^ . : * 

■ Stimulus Imagery. Mission imagery was chosen that was r'epjresenta- . 
. tive of "Army reconnaissance phdtography as to type, quality and scale. 
Further, the test materials issued to the subjects were printed' on ^two 
tyj^e^of emulsion bases — paper and transparent (film) . Preliminary' tests 
coufirmed that more of the available resolution in, the negatives'^was^ 
retained, l)y transparent prints than by paper prints. (A 40 iines/mm :.photo-' 
, negative; ^contacted onto standard photographic, paper produces paper 

prlipits hatving a ground resolution of about 22 lines/mm. The same negative. ^ 
contact printed onto copy film produces . transparencies < having a ground • 
resolution of about 32 lines/mm,. An 80 lines/mni negative yields 3l0 ^r^nes/mm 
paper prints and 55 lines/mm transparencies). One portion of the experiment 
designed to compare "transfer performance when using paper prints ("low" 
resQ.lution) with performance using transparent prints ("high" resolution) • ^ 
The characteristics of the mission and. data base imagery are shown in 
Table 3* - ^ j . 

^ Point Selection . Transfer points were selected by examining th^ 
raissiorr and thfe data base photographs using ,6X magnifiers. The points 
were selected carefully so they could be classified logically. in terms 
of their proximity to features. Although three ^levels of proximity were 
. considered originally, it was found that a two-j.evel classif icationj 
Type A and Type B, was more meaningful. The two types of points are- r.-'-'^- 
defined as: * 

Type A - Points on a feature identifiable on both the 
mission and the data base photographs. (For 
I example, a point on a road intersection,* a , " 

/building corner, a bridge, or a drainage 

\pattern.) V ~ * . 

Type B - Points which are more- than 200 meters. from 
'■^ a point identifiable on both the mission 

and data base photographs. 

. Test Materials . Test ma^^erial produced for each subject con- 
sisted of four frames of mission imagery and their associated data ' 
bases. Tj?7o frames were paper prints and two x^7ere transparent prints. 
The data bases were printed on a pigmented 'film base. 
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Table 3 



Code Location 



.Al Ft.Belvoir.Va. 
' V A2^' ' Ft. Belvo'ir , Va I 
.* A3 , F t . Belvo iri 1^a ^ 



A4 

: ^? 

ci 

Dl 



Ft.Belvoir^Va. 
f.t:.Sill,Okla, 

Tt.Sill,Okla. 
Alexandr ia , Va .. 
Alexandr ia ,Va . 

Syracuse, N.Yr 



eHARACTERISTICS OF ^THE MISSIONS AND 
. ^ \ THE DATA BASE ' PHOTOGRAPHY 



Mission ' PhotcAgraphy , ^ 
' Type of Photography [Scale 

High Alt. Vertical 1 : 20, OOO 

,,Hlgh, Alt.'yertlcaifi^f' 1:20,000 

Low AltiVertlQal / 1:5,000 

Lowo Alt.-'Verticai 1:5,000 

Lovji^- Oblique . • 



Low Oblique^ . . 

High Alt.Panoramic^ 

High Ait •Panoramic 

■ »' _ 

Low Alt . Panoramic 



1:10,000 . 
(at nadir)^ 
1:10,000 ' 

1:!?0,000 

(at\ nadir) 
1:30,000; 



D2, * Syracuse, N.Y. ^ Low Alt .Pahoramiq 



l:30j000 
(at nadir) 
l:30,.OOd Paper 



Photo Base 
Transparency 
Paper 

Transparency 
Paper , \ 
Transparency 

Paper 

Transparency 
Paper 

Transparency 



Data Base Photography 

f- ' ' ' 

Scale 
1:100,000 ' . 
- \. 1:100,000 
' yi: 100, 000 
1:100,000 



Photo Base 

Qronapaque-/' 

Cronapaque 

CrOnapaque 

Cronapaque 



Code^ Location 

^ 5" ■ > , ■ 

A > . Ft.Belvoir,ya.^ 
B . . Ff •Sill,Okla. . 
C. * - • Alexandria, Va.:S/ 
" *b . ■ . Syracus^N . Y . 



See Figure 1 
Se' Figure 2 

^ Set: Figure 3 ^ . , 

rr^ Qronapaflu^"\^s^ the trade naflne for 'a translucent, Ipw-shrink film • 
used'^for.the APPS data base. Commercial or trade names are given 
onj.y ^n tjie interest of precision in; reporting experitnental pro- 
/ cedures'^ Use of the names '4oes no t "constitutq of f icial . endorsement 
by the Xrmy or by the U.S. Army Research Institute for the Behavioral 
and Social Sciences . 



ERIC 
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Pilat Jests . / n^* 

, Piloy^ests wei^cQnducted prior to the principal t:est§. The purpose 
of r tliese tests was to provide a realistic assessm*nt of tihe test materials, 
test equipment, test procedures , mensuration, an«.i' data processing.^ Al§,o, 
these tests provided useful data on the time that wofild ^e required t^ ^ 
conduct 'the principal tests. Personnel from th^e Army Research tnst^tutQ, 
the Enjjirieer Topographic 'Laboratories, and the contractoy participated 
in-* the tests'. All pilot test data were measurcid, graded, and analyzed. 

Subject Training - ^ - • i. 

» Test/ Equipment, consisting of a. light ^table, two isix-power magni- 
fiers, a pdin*- marker, an electrical timer, and a high intensity goose- 
neck lamp, was issued to each subject (See Figure 4), Photogrsrjphs of the 
APPS equipment "were shown, ^he equipment was described and the* subjects 
were told tha '.purpose of the tests • They were instructed on use of the 
test equif>ment *and on techniques for making j)0 in t transfers. Sample 
mission and data base photographs were issued and the subjects were asked 
to practice transferring points from a mission photo to the data base4 
'Instructor personnel observed the subje^s to ensure that each one was 
adequately prepared for the tests. • ' 

Data Collection (Principal Tests) * 

packet of test material containing all mipsion photos, data base 
photos, and sheets for recordin^^ the time . taken for each transfer was 
issued to <ench subject. I'he subjects Were told that, even CaougU time 
was being recorded, there v/as no time limitation and that at: curacy, noi; 
speed,, ,was of paramount importance* Each subject was required Lo trans- 
fer 30 points on each of fqlqr-^ission photographs by marking the location 



of each point on a data b^ 
each point. ■ 



il and recording the, time taikenf* to. transfer 



« ■ 



It required from 1 to 1% hours to transfer the 30 po,ints from a 
single mission photographs ; After each session, a critique i;as held to 
-.get the views' o£ the test s'ubjects concerning the tests and the test 
..^equipment . All tests were completed in seven v/orking days . 



-A 



'Jive mission photos wr?rc u:":Gd in Lhe tests but the two vertiealis 
coy6red the same ground area. Only one vertical mission photo was 
assigned to a tsubjcct* * . 



-12- 

i9 



• Stacis tical ComiJUtaLions / . ; 

• Preliminary Screeni ng, of Uat g.. Inspection of the location erro: 
data revealed that 3 ^ol" the , AO subj eccs^ did not follow the procedures 
. adequately, so these *subjects.V data were hot usid. In, addition, one 
subject's d'ata for the high pah photo Paper A points were not used. It 
Was^ apparent that on half of the Far points, he had misidentifj^ed the 
appropriate f.eatures in the data base. - ' 

The data from thre^ points in the low pan photos- were also climi- ./ 
nated from the analyses. One point was a Far "^A point, one a. Near A ^ 
point, and .one a Far B point. One of tiie points was eliminated because' 
a valid solution could .not be obtained for its true location. The other 
two poirits were eliminated be.iuse over half of ^e subjects did not 
attempt to transfer then. Thus for the low f^an pho.cos. there remained, 
'a total of 7 Far A points, 6 Near A points, 7 Far B paints, and'? Near 
B points ^ ^ ^ ' 

;/ About 2% percent of the required triinsfers were either fnissing or 
could not be scored for the fcllowing reasons; the S^^ubject made a long 
scratch or the pinprtck.was sc large 'that the intended loca^tion of the point 
cpuld not be determined; he selected t]ae wrong point; or, by far the t 
common reason, no pinprick cou__J hre found on the data base, or the s ..^ cic 
noted that! he could not find rr;a point on the data base photo. 

■■ , ■ ' ■ ^ 

After the study v/as completed, it was disco\^ered that, due to > 
clerical ^rror, half of the subjects assigned to the oblique photos 
were not^iven the point numbers appropriate for these photos. Ins^t^ead, 
Lhcy were given the 30 point r.uinbcrj :-opri7te for the vertical . 
photos'V As a confsequence, these subjecLS transferred \l\ A poiut^'^and 
'16 B poinLS> instead of 15 of each ty]pe^r-="'T^n A points' and 7 B po'ints 
were in .cuinmon -with, the pfcin ts transferred by the other half of the 
subjects. This -did not seriously a^-ect the data analyses. - * 

Proparntion ^f the Data f or S t a t i t i c a 1 Ana 1 ys Is . The measure of 
each subject's location ^ror perfcrnahce for a particular experimental 
condition was the inedic^n of the errors he made on the points for -hat 
condition. The median rather Lhan t: : - mean error^was used oacanS'j, for 
'n^any of the subjecLs, the dis^r:.^^' of errors across |:oints was 

r,'eney .'illy positively skewed; ^ii.. nany 5nbj<;^cts made a l^rge error 

on one or two of the point-.-. 1.: ject Wris mi.^J^ing an rror ■ iS'iore - 

for a partLCuictr point, he- wa n;::jd an a r t: i f ic ial scor.^ which was 

the median of the other subji. ; -r^'ors ■ tor that point. ' 

For the vertical photos, v ^.^diati errors were compu for each 

subject — one based on 15 A po'-f :kI one based on 15 B ];ti.nts. vor 

the non-vortical photos, four lars wer- computed for eacn subje-:; 

for the. high pan photos,* the^r -^n~ ve.r'. ase-: on 8 A aiia ^ B Par 

points, and 7 A and 7 B Near r . -s; tor .e Lew pan pUoto:^ the 



medians -were* based on 7 A and 7 B Far points, »and 6 A and - 7 B Near . 
points; for the obli.que photos,^ the medians for half of the subjects 
were basec 8 A and 8* B Far points and 7 A and 7 *E Near points; and 
for the othju^h' :^ of the subjects, the medians were based on ^ A. and 
8 B. Fair £oi^^ 4fcd A and 8 B Near points. 

MeanA|dBe rjectVs median errors were used in testing the 
statis t.ica^^^^Bf ican.ce of the ef f ects "Uf the various independent vari- 
ables. Th^^^«isfric3l. tests (analysis of variance ^jwd t tests) v4|^e 
^used to te^JHj^ only the significance, but to deneraine whether or not 
levels. of the indepenaent variables should be comb ijied for descriptive 
purposes . ^ . - ^ 

Scoring . , 

Point cation. Standard^ . Point location standards (school 
solutions) were established for each frame of mission imagery. 

The A poinns oil the mission' photo were located visually on the 
data base and th^i^ location of each point was marked with a pin prick. 
The B points couxd not be transferred accurately in this way. A series 
of tests showed that sufficient accuracy could be attained by analyti- 
cally transferring the B points from the mission to the data base photo- 
graphs. To perform this, an -eight^parameter projective transf ormat,ion 
was chcj^en and programmed on a CDC 6600 digital computer. 

^ The true locations of the points were dc1:er*Tiincd in the rollowing 
manner,: Each mission pteto, v/hich had been marked with A and B points, 
^v/as placed in a precision comparator and the coordinates of all points 
were measured and recorded on p inched cards. The corresporfding data 
base photo was plac^ed in the coinparator and the fiducial markers and 
alLA points were measured and recorded on punched cards. A seri-es of 
local transf oniiatiOi-3 was set up, A local transf orr^2.zion was. made up 
of B points surrounced by A points.' (Additional "ccrirrol" points wer^ 
added in areas where there v;ere. not enough A points j effect a strong 
trauj^f ormat ion . ) • Since the A points were measured c bo th^ the nission 
and the data base photographs, transformation paraneiers could be 
computed. Using these transf orniation^pararr.^ters,' t::_ B points 
(measiiVed on the mission imagery only) v/ere tr.-.nsi jrT.ed into the data 
base coordinate system.^ The computer program printed out the X and Y 
residuals of the A points. The si^e of tht residual, was a good indi- 
cation of hov; v/ell the^E points had been transformed A typical layout 
of A and B points for an oblique local transf ormatior. is sho^m in 
Figure 5, * The^ computer printouL lor this is shown in Figure 6. 

The true -^ocn tions, then, are the data base comparator coordinates 
of the A points ;ind the transformed locations of the B points, ill the 
data base coordinate system. , , 
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Figure 6. - Typical Printout For A Local Transformation 
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Mensuration and Error VecWr Computation , - Each' of the^ forty 
(40) test Jiubjects transferred thirty (30) . points td each of* four data; 
base photographs;. E^ch data bcise was placed in^a precision comparator 
and rhe coordinates of rhe four f*iducial- marks and the 30 points were 
measured Jhe output of tshese measurements was* a punched card for each 
transferred point showing th4 5»ubject NumberJ^ the'Mission thoto Code 
(Bi, B2, ^1, etc.) and the x anfl y coordinate^ of the point, 

' ' ^ . > . • • ^ • ' 

Programs were^ written for the CDC 6600 computer, to pVotess the 
measurement Sata. A tra;nsf orination program was used^to place the sub- 
ject's measurements into the appropriate data base coord;Lnate system,. 
Thus, the coordinates of all points on the subject's data;base could be 
compared 'directly with' the true coordinates of thfeir conjygate^ points . 
The computer' ftintout contained ,th^ errors in <x and y and the error 
vector (locationt er^:©r) for each point, in micrometers (See figure 7) • 
At the scale of the data base (1: 100, 000) ten micrometers "equals one 
meter on tjie ground. ' ^ ' 



RESULTS 



Marking Errbr 



One factor that has a dirdct bearing mi transfer accuracy is^^the 
accuracy with which a person can-^rk a prq-selected point. Tests* 
raadj& with six ' subjects • showed that, at a scale of 1:100,000, the error 
in markinc waS less than two meters on^the* ground . 

Location i^rrors ' 

The location ^errors for each type of mission photo are described 
in the following four sections. Within each section,' the results for , 
the A points are presented first, and those for the B points second. 
For each type of point, there' is' a table of error means by levels of 
the incepeident variables, statistic^al tests , of the effects of the inde- 
pendeilt variables, and a des.cription (or descriptions) of tjie location 
error i- ' iie^form of cumulative percentage distributions. Descriptive 
statist: -cs based on the cunuiative percentage of error in meters were 
considered more appropriate than those based on the normal distribution 
assumption because the distribution o^f errors was positively skewed. 

A cumulative percentage distribution was presented for each level 
of the independent variables if the effects of that variable were sta- 
tistically significant (p < .05). If the effects of a variable were not 
statistically significant, the data were combined into a composite 
cumulative percentage distribution. Artificial error scores ar^e not 
included in these distributions. 

• Vertical Mission Photos . Table 4 shows the error means for the 
vertical photo A points. It is apparent from the table that there were 
only small and negligible differences amoog the means, for\i:he different 
combinations of Print Type and Scale. 
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li;?';i7.29l 
1:1337. ,22 



TR^N y 


RES, X 


R£^ y 


ERR VECTOR 


l»8952b,9ai 


1.17,298 ' 


73.019 




■'•Jfl«7,lZD 


-1(6.030 


-73.125 


, ' '86 


, vn335.5i.9 


. ' -33.560 


-36.5'.9 


50 


;7aii3&,fi39 


-8,31.2 


•1/73.151 . 


173 


'•71.169'. &19 


/. i»10.677 
• ' -'.'..319, 


-23!. 519 


W5 


'♦8eo33.531 


-35.531 


.57 


V83J'27. 505 


'?l597.9b9 


l6'.."i,95 


^ li09 


i.79';n.b,l03 


•i.i'.^S9 ' 


-27,103 


52 


•<t7SlS9.i.03 


209. 81.8 ' 


-2010. hD3 


2021 


.i»7i, •07.61,5 


i 579.1.08 , 


1521. 355 


1^28 


i»9l 175.225 




130.775 


. ; 318 


^35'.65.19l 


r.,1.03 


-13,191 ■ 


ll. 


1.3I.21I..207 


85.7/2 


-13.207 


^ 88 


It79ii07.3r9 


•1'5.833 


' 22. 6U 


. ^ 28 




-127V.603 ■ 


-54.915 


1278 


1.71.773. J30 


, -175.189 • 


\ -1.330* 


175 


., i»9OC90.i.2b 


6.930 


29.57'. 


_ 30 


4161.35.550 


3/1. 233 'T' 


1,4.350 


~ 59 


1. 31. !">7 1,01,1. 


•96.9lb 


21.956 


99 


i.3130i.59B 


. -2bi,.i.77 


•21.591 


• 265 


'491'.22.nD . 


•7.3ob 


33,331 


35 


<t3c(i3^,7:; 


-1.57.965 


•28. 755 


459 


'»eVb9.7<)b .. 


„. 1-131.327 
'-152. 7b9 


••.7, 796 . 


KO 


1* 4,0 il2.b, 1,60 


359.51.0 


391 


1.90068.516 


-I07.i.7j 


537. (.81. 


$<.! 


Iifl9i.75,0(1 


199.503 


•ees.Obi ' 


J2I. 


vA3G5fl0.565 


-232.751 


-127. 563' S 


265 


i,3v;'25.f92 


-•95.765 


•33.J92 


m 


4Jbr,51.0:b 


-13.3.291 


33,941. 


109 


i.a<.-0i..2U0 


•5U,422 


•i!i9.2oa ■ 





VEI^TICAL MISSION PHOTOS 
MEAN LOCATION ERROR (METERS) FOR A POINTS 



SCALE ' 


1* PRINT TYP£ 


Me^n 
Total 


Paper 


Trans- ' 
parencv' 


Large' 


* • 
7.6 

(10)i/ 


' s'.s' 

m • 


6.8 


Smal } 


8.7.. 

(lol 


7.1 ■ 

(10) 


7.9 


Mean 
1 Total 1 


< 8.2 


6.5 1 

1 





i/Number of subjects, 



^. An analysis of variance of the data, (Table 5) indicated that t^^e' 
effects of Scale^ Print Type, and; thSr fnteraction between the- variables 
were not' statistically significant. .The data from\all levels of the - ^ 
independent variables were combined.' 



Table 5 



•VERJICAU MISSION .PHOTOS 
. ANALYSIS OF VARIANCE OF 

^LOCATION ERRORS (METERS) FOR A POINTS 



Source 




MS 


F 


Scale (A) 


' 1 


12.28' 


1 .48 


Prints (B) 


1 • 


24.52 


2.96 


A X B 


- 1 


.01 


<1 .00 


Error 


33 


'8.27 





/ 



Figure 8 shows the cumulative percentage of location error (In 
meters) for the A points. The figure may be interpreted as follows: if 
the interest is in the typical Or average error on these points, select 
50% (the median) on the ordinate .and re^d the value on the abscissa 
(location error) that corresponds to the point where 50% intersects /the 



r 




" . , . U3CATI0N ERRORS - 

■ • .' (METERS) 

Figure 8. ' Cumulative percentage of location errors: 
mission photos/A points (N=542). 



vertical 



function.t Ik Figure 8 that value* is 8 meters. This means that half <jf 
the errors were'-less than 8' meters and half were greater than ft meters. 
If the interest is not in typipal perf ormance,- but • ^lanher in some point 
below, say 75% of the errors 'fa.ll. select- 75% on the ordinate and determi 
the corresponding error value on'-t'he abscissa. -In Figure. 8 that value is 
11 meters. In other words, 75% of the errors were less. than 11 meters 
and 25% were greater thaa ll met'er^. Interpretations may be made^ in the " 
same way for other percentages,. . \ ' 

^ Table 6 shows the 'error means for the vertical photo B joints.' 
Though the^ mean errors for the'Paper Prints were slightly larger than 



ne 



uiic ^ vdj. idu-Lca wcLti ttot scaciscicaixy signiricant. 
levels of the indepertdeift variables were combined^' 
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■ Table 6 

VERTICAL filSSiON PHOTOS 
MEAN, LOCATION ERROR (METERS). FOR B POINTS 





PRINT. 


TYPE 




SCALE 


Paper 


Traris-' 
. parencv 


Mean 
■ T.otal 


• t,a.rge 


23.9 
(10)§/ 


20.0 
(8) 


22.0 


' Small 


27.1 - 
(10) 


20. -7 


23.9 


Mean 
.Total 


- 25.5 


20.4 

±- — '. 1 


23.0 



i^lumbef of subjects. 



- / 



Table 7 - 

VERTICAL MISSION PHOTOS ' 
: AN/VLYS.IS OF^VARIANCE OF . ' 
■LOCATION ERRORS (METERS) FOR B PCjlNTS 



Source ' 

Scale CA) 
Print (fli 
A X B ^ 
Error, 



1 

- 1 

33 



34.59 <\ 

242.61, > 3.73 
13.83 <1 
64*98 



**: Figure 9 shows the cumulative percentage of location errors for 
the vertical photo- B points. The median error was about 20 mefters. 
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.10 20 30 40 50 . 60 70 80 90 

,\ * /LOCATION ERRORS 

: ' ^ irOERS) 

Figflre 9. Cumulative percentage of location errors: vertical 
. misjsion phdtos/B poipts (N^bSO).^^ 

. - .* QbJ.ique >ti3slon Photos > ^ Table S-shows the error means, for the. 
oblique photo A points. (the mean^ are based on the performance of two 
subgroups of subjects. As pointed out earlier, the two subgroups did 
not transfer all of the same points.) The error means were larger for 
the Far points tlian •£ or the Ne^r points and larger for the "^Paper than 
for the- Transparency . 
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Tab! e 8 



. OBLIQUE MISSION. PHOTOi_ 

MEAN LOCATION ERROR (METERS )" FOR A" POINTS 



POSITION 
OF 

POINTS 


PRiriT TYPE 


Mean . 
Total 


Paoer 


Trahs- 

■ oarency . 


Far 


24.6 

(i?) 


20.8 
(18) 


22.7 


Near. 


. 16.6 
(19) 


•9 .3 - 
(18) 


13.0 


H Mean 
P Total- 


20.6 


15.0 


17-8 



But an analysis of variance (Table 9) indicated that, the effects 
of Position, Print :J'ype, and the interaction between the variables, were 
not statistically significant. The Hata from all levels of the inde- 
pen(4eiY£ variables were, combined. - 



OBLIQUE MISSION PHOtOS 
■ANALYSIS OF VARLANCE' OF 
LOCATMN ERRORS (ilETERS) FOR A POINTS 



Source 



Betv/e^n 
Subjects 

Prints (A) 

Groups 

Error 

Within 
Subjects 

. Position (B) 
A X B 



1 

■ ' 

34 
37 



MS- 



I ,9)5 
I ,080 
537 



505 
152 



3.57 
2.01 



2.28 
<1 .00 



/ « >' . ^ 

: Figure 10 shows the cumulative percentage of -location . error for 
the oblique photo A points • ; The median error ^was about l-l"iiieters, : 
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■ : - . ^ . . - - LOCATION -ERROR? ' ~ " - 

■ TT, - , ■ . (METERS) , : - . 

>^ Figure TO;'.: .tdmulative percentage- of ipC£ition;rerror^^ 

mission photos/A points :(N=529). r': v V ; - - : / ^i: • ' 

■ -■ . ■ ■. . ■ . - -^-^ . ■ • ■ . '■ - ' 

Note that the median error Is somewhat smaller th*an the mean total 
of 17.8 meters shown in Tablet 8. This difference is- jiue Xo the pqai-- 
tive skew of the eriror dlstr ibiitlbn. , If a distribution of measures is 
positively skewed, the mean will bfe larger than the median, and the 
magniLtude of the difference between the mean and" the median wilL depend 
upon the amount of skqw. Differences betv/een the means and medians 
will be evident in the remaining results and will not be commented on 
further t 



Table 10 shows -the error means for the oblique photo B points. 
(As with the A points, the^means are based on the performance of two 
subgroups.) The error means were larger for the Far points than for 
the Near points for both Print TypM^, but there was no substantial, 
consistent difference between tlie means for Print Types. 



Table 10 

OBLIQUE MISSION PHOTOS - 
MEAN LO.CATION ERROR ^METERS) FOR B POINTS 





POSITION 
OF 

POTDTS 


1 PRI.\'-T 


TYPE ' 






1 Paoer 


Trans- 
parency 


Mean 
Total 




Far 


132.2 
(19) 


138.3 
(18) 


135.0 




• Near ' 


35.5- 
1 (19) 


34.4. 
(18) 1 


35.6 




. Mean 
Total 


83.8 


86.3 1 


85.0, 



. An analysis of variance (Table 11) indicated that only the effect 
of Position was sjgtistically significant (p < .01). The data from the 
two Print Types^yere combined for the Near and, for the Ear points. 



Table 11 

oblique' MISSION PHOTOS 
ANALYSIS OF VARIANCE OF 
LOCATION ERRORS (METERS) FOR B POINTS 



Source 



df 



MS 



/ ' ■ ■ ■ 



Between 

Subjects 36. 

^Prints (A} .1 

Groups 1 • 

Error' 34 

Wit^hin 

Subjects 37. 

Position (B) 1 

A X 8 1 

Error 35 



114 
556 
4, 150 



<}lo- 

< 1 . 0 



185,626 , 58.24»» 

237 ' <1 .0 
3,187" 



*»p < .01 



t 
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Figure 11 shows the cumulative percentage of error for the Near 
and for 'the Fat, B point The mbdian error for the Near points, was 29 
_ meters and „f^r/ the Fa _ 1 . ' . _ , 




LOCATION ERRORS 
(METERS)^ 



Figure n ; Cumulative percentage* of Ideation errors: oblique 
mission photos/B points, : ^ 



Hi gh Pan Mission. Photo s:. Table 12 shows the error means for the 
high pan photo A points. The error means were, larger for^ the Fat points 
than for the Near points for both Print Types/ larger for the Papei: than 
for the Transparency for both Positions. 
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Table 12 



HIGH PAN MISSION PHOTOS 
\ MEAN LOCATION ERROR (METERSi||FOR A POINTS 



POSITION 
OF 

Poir.'TS 




Mean 
Total ' 


Paoer 


Trans- 
parency 


Far 


20.6 

ns) 


11.8 

MS) 


16.2 • 


Near 


10.9 

(13) 


6.2 


8.6 


Mean 
Total 


15.8 


g.'o 


12.4 



An analysis of va:rlance (TabJ.e 13) indicated that the effects of 
both Print Type and Position were statistically significant (p < .01), 
but the interaction between the two^ variables was not. The^data from 
the two Positions were combined for the Paper and for the Transparency 
and similarly, the :^data from the two Print Types were combined for th 
Nea? and for the Far points. 



Table 13 

HIGH PA1% MISSION PHOTOS 
ANALYSIS OF VARIANCE OF 
LOCATION ERRORS (METERS) FOR A POINTS 

Source df MS F 



Between 

Subjects 35; 

Prints (A) J 832 9.04»* 

Error 3.4 " 92 

Wltliin . : - ^ - ^ ' - , . 

Subjects ^ 11 

Position (B) 1 1,039 20.78»* 

A X B 1 ^ j j ' 1 .5^4 

Error 34 50 



Figures 12 and 13 show the cumulative {)ercentage of errors for the 
Paper and Transparency and for" the Near and Far points. The median 
error for the Paper was- 12 meters and . for the Transparency 8 meters. 
"The 'medaan error for tlie Tar^ point? was 12 meters and for the Near 
.points 7 meters. <■ 
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Figure 12. Cumulative percentage of location errors. High pan ' 
mission photos/A. points; Print Type. • 
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misSjion phptos/A points; Position .r 



. , 'Tabl^^^]L4 .shows the error means- for the high- pan photo B points. 
The* error means were larger for the Fair points than for the Near^ 
- points for both Print Types, but. there was essentially ho differ<!!nce 
between the means for' the Paper and Transparency. " 
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Table 14 

HIGH PAN MISSION PHOTOS 
.H£AN LOCATION ERROR {H£TERS) FOR B POINTS 



POSITION 
OF 

__P0ir^TS 


PRINT TYPE 


lie an 
^ Total 


Paper 


Trans- 
parency 


Far 


57.1 
' (19) 


56.0 
(18) - 


56.6 


Near 


38; 2 


35.3 


36 . 7 ' 


Mean 
Total 


* 47.6 ' 




46.7 



An ^nalysfi of variance (Table 15) Indicated that only the effect 
of Position was statistically significant (p. < .01). The data from the 
Paper and Transparency were combined for the Near and for the Far 
poiats. 



Table 15 ' 
HIGHxPAN MISSION. PHOTOS 
ANALYSIS OF VARIANCE OF 
LOCATION ERRORS (METERS) FOR B POINTS 



• Source 



-Btjtween " 
.Suijjiects 

• • * * » " - ^ 

■ Print (A) 
Error 

Within ' 
Subjects 

Position (8) 
A X B 
Error 



'p'< .01 



df 

. 

1 

35 
37 

i 

1 

35 



MS 



76 
749 



7-, 255 
1 5 

. 348 



< 1 . 0 



< 1 . 0 
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Figure 14 shows the ctunulative percentage of location error, for ' 
the high pan mission photo' Near and Far B polhts. The median error.;.for 
the Far points, wa's 48 meters, and for the Near points .34 -meters. ' ' " 
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Figure 14. Cumulative percerrtage of location errors: high pan 
mission photos/B points. , . 



. Low Pan Mission Photos . Table 16 shows the error means for the 
low pan photo A points. The mean error for the Paper/Far points was 
considerably larger than for any of the other three combinations of Print 
Type and Position, , and the error mean for the Transparency/Far point was 
somewhat 'larger than tha't for the Transparency/ Near point. 
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Table 16- 



LOW PAN MISSION PHOTOS ' 
MEAN LOCATION error; (METERS) 'FOR A POINTS 



POSITION 

OF . 
- POIf.'TS 


■ PRINT -TYPE ■ ■ 


Mean 

T0t2l 


Paoer 


Trans-" 

parcncy 


' Far ■ 


59.1 
(18) 


15.6 
(19) 


37.4 ; 


Near 


6.3 

(18) ' 


7.1 


6.7 


Mean 
Total 


32.7 


11.4 


22 .0 



An analysis of variance -(Table 17) indicated that the effect^of 
Print Type and Position were statistically significant (p < .05 arid 
.01, respectively) as \>ell as the interaction between the two variables 
(p < -01)- ^ ^ ' ^ ^ 



Table 17 ^ . 

LOW PAN MISSION -PHOTOS 
' ANALYSIS OF VARIANCE OF ' 
LOCATION ERRORS {METERS)-FOB A POINTS 

SburcQ df MS . F 



Between • , 

Subjects 36 ' 

^Prints (A) l , . 8/410 

Error 35 ^ 2,054 

Within / 
Subjects . 37 

Pos'ition (B) l 16,743 8.61** 
A X B 1 9,031 ;^ 4.e4** 

Error 35 1,944 

*i? < .05 
**p < .01 



■ It is apparent ^fromitlspect ion of Table 16 that the statistical 

signif ieaTice of the two variables is due almost entirely to tjhe large - 
error on the Paper/Far poii*t combination. A.fc test for correlated ol)^ 

...sep^ations indicated that for the Paper the differenceL betwcea th^ 

means for the Far 'and Near points was statistically significant 
(t - Z.59, p < .02 df 1 and. 17); but; for the-^Tf ansparency, the dif- 
ference ^etweqn the means for the Far and Near Points was not dtatis- 
,tLc?&lly significant (t = 1.67)1 Conse^ently, only the data from Paper 
'^and Transparency "Near poliits were combined. 

Figure is jBhows the cumulative percentage of error for the low pan 
photo A pointsC Three cumulative percentage distributions are shown: 
one for the Near points, one for^the Transparency/Far points, and one 
for ,tlie Paper /Far points. The median error for the Near points and the 
Transparency/Far points was about 8 meters^ and for the Paper /Far 
points about l5 meters. ^ . ' 




- Near (N=21i3) 

- Paper (N=120) 

^ Transparency 
(ii=124) 
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Figure 15. Cur.iulative percentage of location errors: Ipw pan 
mission photos/A points. ^ 
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Table 18 shows' the error means "for the low pan photo B points. 
Thib-' error ii^eans for the Fnr points were considerably larger thaV 
. -tho^e for the Near poi^its for bath th^^^ and Transparency^ The: 

^ difference betwee;i means for the Paper N^ar ,and Far points was con- 
siderably larger than the* difference between the means for the Trans- 
parency Near and Far points. Th^re was little difference between the 
means fov the.. Paper and Transparency Near . points. 

. • . Table 18 - 

- • - LOW PAN MISSJOTI JgHOTOS ' - \^ 

MEAN LOCATION. ERROR (HETt^J FOR B POINTS 



POSITION 
■ *0F 

• pnir.'TS 


H : 7— ^ 

PRINT -TYJ«^ . 


Mean 
Totial 


Pacer 


Trans- 

parpn.cv 


• Far . , 


225. 1 
' (18) - 


117.8 
09) 


• 

il 71 . 4 


• Near 


. 42.5 
.' (IS) ^ 


48.3 . 
(19) 


45(4 


Mean • 
' Total 


133.8 


83'^> . * 


108.4 



Att analysis- of jvariance (Table 19) indicated" that effects of Print 
Type, 'Position, and the .interaction between the two variables i/ere 
statistically sigrtificant (p ^ .05, .01, .01, respectively) . 



Table 19 
LOW PAN MISSION PHOT^$ . ' 
- AftALYSiS ',0F "VARIANCE'\)F 
^LOCATION ERRORS TmETERS) FO^ B POINTS 



. ^ Source df * MS F 
Be twJen 

Subjects l^L - 

Prints (A) 1 47^568 7.12* 

Error . 35 6,677 . . 

Within . 

Subjects ■ 21 

Location (B) .1 286,792 53.76** 

A X B 1 59, I 12 1 1 .08** 

Error 35 5,335 



At test for. correlated observati'bns indicated that tha difference 
between means for the Paper Near and Far points and for the Transparency 
V. Far,apd Near points was statistically significant: the values for t 
were 5.44 (p < .OX, df 1 atid t8).' atid 5 .97 (p <■ .01, df 1 and 17).' At 
test for uncorrelated observations indicated that 'the difference betWeefi 
means for the Paper and Transparency Far points was also statistically 
.significant (t = 3,02, p < .01, df 1 and 21)1/. The difference between 

means for^the Paper and Transparency Near points was 'not statisfically. 
^ significant. Consequently, only the data from the Paper and Trans- 
parency. Near poincs were combined. • 

Figure 16 shows the cumufative percentage of error for the Ibw' pan 
•photo B points. Three cumulative percentage distributions are ^lown: • 
one' for the JJear. points, jone for the Paper/Far points, and one foK^the 
Transparency/Far points. The median error f or ■ the Near points was 39 . ^ 
meters; for the Paper/Far points, about 183 met^s; and f or , the Trans- . 
parfincy/Far points, about 100 meters. 

, ■ d . ' . ■ . ■ ■ 

Point Transfer Timfes ' ' 

Visual inspection of the times taken to transfer the points re- " 
vealed no practical differetices between the levels of independent 
variables of Scale, Print Type, or Position. The differences 
among the levels of tliia variable were On the order of fractions of a 
minute. Generally speaking, the mean time taken to transfer points 
was about 30 seconds on the vertical photos and about 50 seconds on ^ 
the non-vertical photos, . . , ' * 



df is 21 instead. of 36 because 'the variance of the two samples was not 
homogeneous. This technique oJ testing hypothesis about the difference 
betr^een two means when the population variances are not equal is de- 
scribed by Welch, B. L. (1947). ; In Winer, J. .B., Statistical^ PririQi^ 
pies tn Experzmental^ Designee p^. 37 . New York: McGraw-Hill, 1962. 
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■ . : r " ' T SUMtlARY AND DISCUSSION 

Because of the large number of independent variables and 'types of 
mis.sio;\>l.hotos, a summary of the location error results is provided ia 
Table 20. 

Table 20 ' 
SUMMARY OF RESULTS FOR LOCATION ERRORS 



MISSION 
PHOTO 


POINTS 


INDEPENDENT 
VARIABLE 


y - 

STATISTICALLY 
SIGNIFICANT 


1 r V C I C IT 

LtVcLb Ur 
VARIABLE 


ERROR (METERS) 


25%, . .50::. 


75% 


• \ 

Vertical 

-V 


A 

— --^tr 


Scale 
Print 


• No 
No 


All le*vel< 
comb i ned 


4 


7 


1 1 


' B , 


Scale 
^Pri nt 


_^ 

No 
No 


Al 1 1 evel s 
comb i ned 


' 12 


20 


36 


. Oblique 

r=== 


A 


Print 
Position 


No 
No 


All levels 
combined 


6 • 


11 


28 


B 


Pri nt 
Position 


No . 

Yes 


r a 1 — * 


44 


104 


229 


NearJ/ 


14 


29 


54 


\ 

High Pan 




Print 


, Yes 


Paper 


6 


12 


35 


Trans- 
parency 


4 


8 . 


16 


Position 


Yes 


Far 


6 


12. 


32 


N e a r 


3 


7' 


14 


B 


Print/ 
Pos i tion 


No 

. Yes 


Far A/ 


22 


4'8 


T 

' 97 


Near-2/ 


15 


34 


/ z 


Low Pan - 


A 


•< 

Print 
Post tion 


1 

\ 

Yes 


Far- 
Paper 




19 


165 




Tar- 
Trans- 
parency 


5 


8* 


25 


* 

Yes 


Near^ 


4 


. 8 


'10 




B 


Print 
Position 




Far- 
Paper 


60 


133^ 


43 3 


Yes 


Fa)^- 

Trans- 

parency 


38 


100 ' 


233 


Yes 


HearJ/ 


18 


39 


1 50 



£/Data from' Print Types combined. 
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The table shows for each raVsinon photo and foif the A and B points 
S;^R9^i^t.fJ-y whether or .not the independent variables were statistically 
signif icaint; ■ the l^evelV df^^^^ independent^ variables, for which accumu- 
lative percentage distribution was computed; and the error correspond- 
ing to each of three gelected cumulative percentages. Each percentage 
and associated error may be interpreted as follows: for examj)le, con- ' 
sfder the vertical mission photo A points; 25% of the locatioh errors 
^ere less than 4 meters, 50% were less than .7 meters, and 75%' were less 
than 11 meters. , j ; 

The location error for the three percentages is shown to allow the 
reader to assess the skew of the error distributions. The direction 
and the amount of skew may be computed by comparing (75% -50%^) ■ to 
(50%e-25%e) where e is the location error. If the firstMterra is larger 
than the second, the distribution is positively skewed; ^af the first 
term is smaller than the second term, the distribution is. negatively 
skewed; and if the. two terms are. equal, the distribution is sjmunetrical. 
The magnitude of the difference in these two terms indicates the amount 
of skew* " ' 

■ \ '• ■ . * ■ ^ . 

It is evident from inspection of Table 20 that , nearly all of the 
distributions were positively skewed, with the exception of that for 
the vertical photo A points^a^d for the low pan photo Near A points.. 
The positive skew is attributable to two factors: for most of the mis- 
sion photos, a few of the poii^its were far more difficult to locate accu- 
^ rately than- the remaining points and t^is wa^particularly true for the 
B points and for the Far, points; on some points, a few subjects made 
errors considerably larger than those made by the remaining sub jects • 
' ^ * - ■■ ■ • • ' 

Now to consider the effects of independent variables of Scale, - 
Print Type (Resolution) , and Position , (Near , Far). The scale of the 
vertical mission photos did not affect the magnitude of error. This was 
true for the A points, . points that were on easily identifiable features, 
an4 for the B points — points that were not' close to such" feature^. Scale 
did not affect the error magnitude possibly because the two scales pro- 
vided sufficient detail for locating the points on the data base. 

The variable of Print Type did not affect location error for the 
vertical or oblique mission photos. It did have a statistically sig- 
nificant but small effect for the high pan photo. A points (Paper ~ 

'12 meter median error; Transparency = 8 meter median error); a slightly 
larger effect for the low pan photo Far A points (Paper = 19 meters; 
Transparency ^=^- 8 meters); and a pronounced effect fdr the lov; pan photo 

Tar B points (Paper =^ 183 meters; Transparency = 100 meters). 

Performance with the transparencies v/as considerably better than 
it was with the Paper prints only on the Far portion^of the lov; pan 
photos. This seems to indicate that the ground resolution in the Far 
portion of the mission negative was close to a lev.el where even a 



This has a slight positive skew, but is negiible compared to the otherV. 



small • degradation would cause av^ignif leant loss of the detail useful 
for accurate point transfer. Apparently the transparency preserved 
more of. this useful detail than the. Paper prints Generally, the small 
degradation. caused by the Paper print was not as harmful for the other 
mission photos because the overall quality of the negatives was suffic- 
iently- high so t,hat a small : loss in ground resolution did ijot cause a-r 
significant loss of detail useful In point transferring.. 

As expected, the' variable of Pds/tion significantly affected loca- 
tion error. The error for the Far points was usually larger than for 
the Near point$ and the difference in the magnitude of the • error was. 
larger for the B points' than for the A points. The probable explana- 
tion of the larger etror for the Far points is that tliey were in the 
portion of the mission photo in which the distances betv/een scene 
features are not linearly, proportional ' to their corresponding features 
on the data base, whereas the Near points were in the portion of the 
photo in which the distances were closer ..to linear. 'It was undoubtedly 
more difficult to locate points where the distances were non-linear. 
The effects of Position were larger for the B points than fur the A 
points because, by definition, the A points were located on identi- 
fiable features vzhile tli<^B points were relatively far removed from 
such f-eatures. ' V ' ' f 

i ■ ^ ' ' ' 

/The location error for the non-vertical photo ^Near A points was 

not much larger than tliat for the vertical , photo A ppoints, 'por the 
vertical photos, the 50% (median) and 75% location errors were 7 and 11 
meters; for the non-vertical photos, the 50% error ranged from 7 to 
li meters and the 75% error ranged from 10 to 28 meters. But the error 
tor the Near B points was considerably larger than that for the verti- 
cal photo B points. For the vertical photo, the 50% and 75% -errors 
.v/ere 20 and 36 meters; for the Near 'B points, th^. 50% error ranged from 
29 to 39 meters, and the 75% error ranged from 54 to 150 meters. 

These results indicate that the location error for the. vertical 
mission photos and for the'near portion of the non-vertical mission 
photon are comparable for only specific kinds of points—thoso located 
on or. very close to identifiable features in the scene. 

'For the B points, the location errors for the vertical mission 
photos and for the Far portion of the non-vertical photo's v;ere not 
comparable: the 50% error for the Far points . ranged from 48 moters for 
the high pan photos to about. 1-40 meters (mean of 183 and 100 meters) 
for the low pan photos; the 75% error ranged from 97 meters (high pan. 
photos) to about 335 meters (diean of 433 and 233 meters) for the low 
pan photos. ■ ' 4 

The results of this study, as summarized^ in Table 20 should be ' 
usefur in assessing* the operational capabilities of-fhe APPS for tar- 
gets appearing on various types of reconnaissance photography. .. It is 
apparent that R-type targets usually c^lnnot be transferred visually to 
accfe^ptable accuracies except from- vert ical mission imagery. This' indi- 
cates that other means for transferring- B-type targets should be found^. - 



Overall improvement in point transfer accuracy might be achieved by 
judicious selection, of operators plus specialized t'r^ining. 

This report ^should be useful to G-2 air officers and. reconnais-' 
sance aircraft pilots because it shows, clearly.; the value of acquiring 
targets in a near vertical mode. Of ' cours6, operationally,. Lhis. is 
sometiirfes not possible but at least the operational personnel will know 
the loss of transfer accuracy that will result when targets are imaged 
in the Far 'portion of a panoramic or oblique frame. 

There may^e some advantage in viewing the data base or the mis- 
, sion photography jln a stereo .mode ^hd still fur ther'' advantage if both' 
a^e viewed in stereo. Stereo wjs ,not used in this study but, based on 
past related experience, the use of stereo might improve both A point 
and B point accuracy, but . the greatest "improvement would be Co B points. 

During the: main tests it required an average ot less than one 
minute per poin't to effect a transfer. However, there are two steps in 
the transfer process. The first is fipding on the data base the area ' 
covered by the mission photo. In some preliminary tests this was found 
to be so time consuming (up to 30 minutes) thafe^transparenU templates 
were furnished each test subject so he could quickly locate the areas 
on the data^bases. In areas having linit,ed^ cultural atid pr>pminent 
natural features, the location of the general area of the raission photo 
could become a major problem. The training of interpreters to more 
quickly relate one photo to another, when there is a larj'.e disparity in 
scalfe and geometry, seems essential for efficient operation of theuAPPS*. 
The second step is the finding apd marking of the point of interest on 
the data base. / - 



CONCLUSIONS 

Based on the results of this study and on general observations 
made during the testing phase ijt/is concluded ^that: 

• The test's were conducted according to the test plan 

and were successful in fulfilling the stated objectives . 

• The fallov/ing variables were found to be practically 
significant: ; ^ ^ 

Positiop (Far or Near portion of the forma^ 
of non-vertical imagery) -J 

Poi^nt/Environs (Relationship^of point to 
identifiable detail) 

■ . ^ ■ * . 

Resolution (Transparency vs. Paper Print) - 

significant only f or^ some combinations *' 
vO^>. ^-onditions ^ . * 

• The variable f ound 't^be not practically significant 
is: . • 



. f 



Scale (within operational ranges - ver^id^l 
photography) 



Under the conditions of , the experiment, transfer CEP . 
of less than ^0 meters was obtained for 50 percent of 
the A points transferred from all mission ! types and 
75 percent of the transfers were within a CEP of 20 
meters for Vertical missions, for 'fee Near portion of 
High and Low Panoramic missions, and for film trans- 
parencies for the High Panoramic mission!*^irrespective 
of target position on the image. Only the Vertical 
mission imagery .was adequate for the purpose of pro- 
viding a CEP or 20 meters for the transfer of 50 per- 
cent of the B points. v 

Test subjects preferred transparencies to paper f>rints 
for mission imagery and th^ preferred transmitted 
light (light table) to reflected light (high intensity 
lamp), even for paper prints. 

The cumulative percentage curves are useful in estiinat- 
ing transfer errors for different kinds of mission 
imagery. . • * 



APPENDIX A / 

.."■«>'' 
ANALYTICAL PHOTOGRAMMETRIC rOGITIONT?:G SYSTEM (APPS) 

The Aiial^^tical Photograrnmctric Positioning System (APPS) is a 
point positioning systerJ developod at the US Army Engineer Topographic 
^ Laboratories (USAETL), Fort Belvoir, Virginia. The APPS has evolved 
as' a solution to the problem of ""determining X, Y, Z coordinates of • 
points of interest anywhere in or forv/ard of a Corps-sizp area in a 
niatter of minutes. ^ a 

. ' ' • ' • ■ ■ • ,•^■'1 ■ 

Photpgrnmraetric theory 'and techniques have been combined ""with the 
capabilities of a desk top programmable calculator to provide for 
utilization of the analytical methods gf determining position, unlike 
the more classical analog methods found in phoCogrammetric m^p 
compilation instruments. The problem is treated as an intersection 
problem for which .universally accepted solution techniques are 
available. Numerical data are accepted for certain known parameters, 
and measured photo coordinates are treated^ as the observed parameters,- 
thereby solving for the unknown X, Y,,Z coordinates of a point. 

There are two parts to th^^TXppS; (1) a Data Base (DB) c(^nsisting 
of mapping qyality aerial photbgra^tiy and its associated numerical 
data, and- (2) an assemblage of mensuration and data processing equip- " 
ment with. associated software. ^\ r 

: ' . ^ ^ ' ^ ' J 

The DB is the key element of the APPS. It is rigorously prepared 
as part of the normal mapping process and only then extracted from 
that process -for application to the APPS. The DB is mathematically ad- 
justed by an ^analytical procedure known as aerial block triangulation 
which is based upon the method of least squares. Given two points of 
knovTi horizontal positions (X,Y) and tj^ee poiats.of known elevation 
(Z), one can determine the. six orientaxion parameters of a photograph, 
whether dealing with one Warlapping pair of photop;raphs or overlapping 
coverage of entire countries. Use • is made of. redundant control data 
whenever possible to reduce accumulation of small uncorrected systematic 
errors and random errors. The adjustment is held to ground control. 

^ The DB photograph requires no special processing, such as rectifi- 
cation. It is annotated with orientation points , cilled index points 
and with check .points. Its associated numerica l data includes interior 
and exterior orientation parameters, ph,oto coordinates of the index 
points, and geo(:entric coordinates of the check points. APPS equipment 
calibration parameters are also incorporated in the numerical data. 

• ^ . 

The. other por.tion of.^^the APPS, the hardv.'are, is primarily an 
assembj-g^e of commercial, off-the-shelf item's that will accept the DB 
and p^ifisr'fcjrra the necessary measurements and computations fjr X, Y, Z - 
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coordinates, "J^e* cjiirrent package represents first generation compo- 
nents. Modf5f^j cat tons and add-ons have been envisioned to increase the . 
flexibility of the system. , ^ . 

There are five major component items of equ-^menC to include: 
(1) a modified Zeiss Sterootope^^ (2) an operator control, box, (3) an 
^interface unit, (4) a-ll^^wlott-Pa.c1^nrdi^(HF) 95rOA programmable calcu- 
lator4^"ahd * (5) an HP cassette memory^ . See Figure Al. , 

.ITie Stereotope provides the capability for ^stereoscopic viewing * 
-and parallax measurement by the X, Y and X-parallax motions it pos-. 
sesses. To extract these measurements, a Bendix X, Y digitized data 
^rid^is installed under the Stereotope baseplate and a signal cursor is 
connected to the moveable photocarr iage. Also, a shaft angle encoder 
is connected to the X-paralla^c motion drive. 

The operator control box provides, a simple means of selecting a 
particular operation for the^ APPS to perform, /.e., zero tlje baseplate 
data grid ^atum, or index the/DB stereomodel, etc. 

. The interface unit converts cursor signals to the "llP language and 
subsequently HP language to a desired otitput language. 

The HP 9810A i programmable .c^'^'ula tor and the HP casset te^cmory 
function together. The memory hplds the softv7are progiJsimining and DB 
files on tape covering a Corps sike area for sequential access by the 
calculator. The calculator uses the program and' one numerical DB file 
at a time together with the input from the Stere\)tpp'e through the 
interface to compute the X, Y, Z coordinates oi a point. 

In prao^ice, the operator use^ a photo index overlay to determine 
which DB stereo pair of photograpHs to place on. the Storeotope. He 
inserts the magnetic tape cassette containing the program and DB. 
numerical data files for that model into the cassette memory. He en 
activates the cassette memory to load the programiJby use oL' a magnetic 
card. The card, also contains the Stereotype cali'^rati^ii j^arameters 
mentioned earlier. He then calls *5Ln the DB file for tjie model being 
used by keyboard commands . Each ^fiioto of the mcjdel is oriented inde- 
pendently using the index points meat ioned earlier-s — The photo coordi- 
nates of four index points are measured and a transf ormat'ion computa- . 
tion made to relate the measured photo coordinates to the ad-justed 
photo cuotdinates The operator then' observes and m.easures a check 
point,- this time . in stereo, to ascertain that* he correctly oriented 
the model. He must agree with -the known coordinates of the check 
point within established tolerances before he can jiVoceed. Once he is 
signalled to proceed he then observes the point of interest, measures 
and computes the X, Y, Z coordinates of the point and obtains a print- 
out on paper tape of the UTM Zone, Easting,. Northing and elevation in 
meters'. . 



--/Commerical or trade i^mes are given only ^n the interest of precision 
in reporting €::per imental procedures. Use of the nanes docs not con- 
stitute official endorsement by the Army or by the U.S. Army Research 
Institute for the Behavorial and Social Sciences,, 



Test results conclude that horizontal position locati/J'ns deter- 
mined with the APPS are approximatiiiy equivalent to third-order ground 
surveys. This is readily achieved by personnel haying 4)rcviou,s train- 
ing in the interpretation of aerial 'photographs and additional 16~A0 
hours Instruction on the APPS. ' ■ 
* „ ■ ■ • ■■ - ■ ■ . ' • ^ ■ . ■ . 

The APPS is packaged^for transport in three militaplzed carrying 
cases for a total weight of 478 pounds. and a volume of 27.42 cubic 
feet. It, requires 600 watts of power at llOv, 60 IIz. 



